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■ Abstract 

In this paper, we consider robust control using randomized algorithms. We extend the existing 
order statistics distribution theory to the general case in which the distribution of population is 
not assumed to be continuous and the order statistics is associated with certain constraints. In 
particular, we derive an inequality on distribution for related order statistics. Moreover, we also 
I propose two different approaches in searching reliable solutions to the robust analysis and optimal 

synthesis problems under constraints. Furthermore, minimum computational effort is investigated 
and bounds for sample size arc derived. 
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■ 1 Introduction 

> : 

^ . It is now well known that many deterministic worst-case robust analysis and synthesis problems are 

■ NP hard, which means that the exact analysis and synthesis of the corresponding robust control 
problems may be computational demanding [5l[T3]. On the other hand, the deterministic worst-case 
robustness measures may be quite conservative due to overbounding of the system uncertainties. 
As pointed out in [9] by Khargonekar and Tikku, the difficulties of deterministic worst-case robust 
control problems are inherent to the problem formulations and a major change of the paradigm is 
necessary. An alternative to the deterministic approach is the probabilistic approach which has been 
studied extensively by Stengel and co-workers, see for example, [lOpilj. and references therein. Aimed 
at breaking through the NP-hardness barrier and reducing the conservativeness of the deterministic 
robustness measures, the probabilistic approach has recently received a renewed attention in the work 
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by Barmish and Lagoa [5, Barmish, Lagoa, and Tempo Barmish and Polyak [3], Khargonekar 
and Tikku [9], Bai, Tempo, and Pu [1], Tempo, Bai, and Dabbene [12], Yoon and Khargonekar [14j . 
Zhu, Huang and Doyle [16], Chen and Zhou [6l[7] and references therein. 

In addition to its low computational complexity, the advantages of randomized algorithms can be 
found in the flexibility and adaptiveness in dealing with control analysis or synthesis problems with 
complicated constraints or in the situation of handling nonlinearities. The robust control analysis 
and synthesis problems under constraints are, in general, very hard to deal with in the deterministic 
framework. For example, it is well-known that a multi-objective control problem involving mixed 
H2 and Hoo objectives are very hard to solve even though there are elegant solutions to the pure H2 
or Hoc problems [T5] . 

In this paper, we first show that most of the robust control problems can be formulated as con- 
strained optimal synthesis or robust analysis problems. Since the exact robust analysis or synthesis 
is, in general, impossible, we seek a 'reliable' solution by using randomized algorithms. Roughly 
speaking, by 'reliability' we mean how the solution resulted by randomized algorithms approaches 
the exact one. In this paper, we measure the degree of 'reliability' in terms of accuracy 1 — e and 
confidence level 1 — 6. Actually, terminologies like 'accuracy' and 'confidence level' have been used 
in [12] and [9] where accuracy 1 — e is referred as an upper bound of the absolute volume of a subset 
of parameter space Q. However, in this paper, we emphasis that the accuracy 1 — e is an upper 
bound for the ratio of volume of the constrained subset Qc := { constraint set C holds, q € Q} with 
respect to the volume of parameter space Q. For example, when estimating the minimum of a quan- 
tity u{q) over Qc, the ratio may be ^i"™*^ "voiume^f Qc' where Umin is an estimate resulted by 
randomized algorithms for quantity u{q). We can see that the ratio of volume is a better indicator 
of the 'reliability' than the absolute volume of {u{q) > Umin, Q £ Qc}- 

Based on this measure of 'reliability', we propose two different approaches aimed at seeking a 
solution to the robust analysis or optimal synthesis problem with a certain a priori specified degree 
of 'reliability'. One is the direct approach. The key issue is to determine the number of samples 
needed to be generated from the parameter space Q for a given reliability measure. Actually, 
Khargonekar and Tikku in ^ have applied similar approach to stability margin problem, though 
the measure of 'reliability' is in terms of the absolute volume. In that paper, a sufficient condition 
is derived on the sample size required to come up with a 'reliable' estimate of the robust stability 
margin (See Theorem 3.3 in 0). In this paper, we also derive the bound of sample size and give the 
sufficient and necessary condition for the existence of minimum distribution-free samples size. Our 
result shows that, the bound of sample size necessarily involves p := volume of Qc- Thus estimating 
p becomes essential. Unfortunately, estimating p is time-consuming and the resulted sample size is 
not accurate. To overcome this difficulty, we propose and strongly advocate another approach — the 
indirect approach. The key issue is to determine the constrained sample size, which is the number 
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of samples needed that fall into the constrained subset Qc- We derive bounds of constrained sample 
size and give the sufficient and necessary condition for the existence of minimum distribution-free 
constrained samples size. The bounds do not involve p and can be computed exactly. This result 
makes it possible to obtain a reliable solution without estimating the volume of the constrained 
parameter subset Qc. 

This paper is organized as follows. Section 2 presents the problem formulation and motivations. 
In Section 3, we derive the exact distribution of related order statistics without the continuity 
assumption. Distribution free tolerance interval and estimation of quantity range is discussed in 
Section 4. Section 5 gives the minimum sample size under various assumptions. 



2 Preliminary and Problem Formulation 

Let q = [qi ■ ■ ■ qri\^ be a vector of a control system's parameters, bounded in a compact set Q, i.e., 
g € Q. Let C be a set of constraints that q must satisfy. Define the constrained subset of Q by 
Qc := { C holds, q € Q}. Let u{q) denote a performance index function. In many applications, we 
are concerned with a performance index function u{q) of the system under the set of constraints C. 
It is natural to ask the following questions: 

• What is miuQj, u{q) (or maxq^ u{q))l 

• What is the value of q at which u{q) achieves minq^ u{q) (or maxg^, u{q))7 
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Figure 1: Uncertain System 

Consider, for example, an uncertain system shown in Figure [TJ Denote the transfer function from 
to z by Tzv and suppose that T^v has the following state space realization Tzv 
We can now consider several robustness problems: 

• Robust stability: Let Qc = Q and u{q) := maxj Re Ai(A((7)) where \i{A) denotes the i-th 
eigenvalue of A. Then the system is robustly stable if max^gq^, u{q) < 0. 

• Stability margin: Assume that A(g) belongs to the class of allowable perturbations A which has 
a certain block structure. For a given real number 7, let denote the subset of perturbations 



3 



in A with size at most 7, i.e., := {/^{q) G A : (j{A{q)) < 7} . The robustness measure jopt 
is defined as the smallest allowable perturbation that destabilizes the feedback interconnection. 
Let 7o be an upper bound for jopt- Define parameter space Q by Q := {q' : A.{q) € A^^} and 
constrained subset Qc by Qc '■= {q ■ q ^ Q and A{q) is unstable}. Let u{q) := a{A{q)). It 
follows that the stability margin problem is equivalent to computing 'jopt = minq^ u{q). 

• Robust performance: Suppose A{q) is stable for all q £ Q- Define u{q) := Then the 
robust performance problem is to determine if max^gq u{q) < 7 is satisfied for some prespecified 
7 > 0. 

• Performance range: Let Qc ^ Q be a given set of parameters such that A{q) is stable for all 
q G Qc- Define again u{q) := \\Tzv\\oo- Then the problem of determining the range of the 
system's Hoo performance level can be formulated as finding min^gq^ u{q) and maxggq^ u{q). 

As another example, consider the problem of designing a controller K{q) for an uncertain system 
P{s). Suppose that g is a vector of controller parameters to be designed and that the controller 
is connected with P{s) in a lower LFT setup. Let the transfer function of the whole system be 
denoted as Fi{P{s), K{q)). Suppose that Fi{P{s), K{q)) has the following state space realization 
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Then we can formulate the problem as a constrained optimal 



synthesis problem by defining a performance index u{q) := \\Fi{P{s),K{q))\\^ and restricting pa- 
rameter q to Qc := { maxj Re Ai(^s((7)) < —a, q E Q} where a > is not too small for a stability 
margin. Then the H^o design problem is to determine a vector of parameters achieving min^gq^ u[q). 

2.1 A Measure of Reliability 

Since the exact solution to the analysis or synthesis problem is impossible. Measuring how the 
solution resulted by the randomized algorithm approaches the exact one becomes essential. We 
shall first introduce the concept of volume proposed in [9]. Let w{q) denote the cumulative dis- 
tribution function of q. For a subset U C Q, the volume of U, denoted by "yo/^jU}, is defined 
by uo/^jU} := J^^jj dw{q). Define p := • Then it follows that p = volwiQc} since 

fo/uj(Q) = 1. We assume throughout this paper that u(q) is a measurable function of q and that 
volwiQc} > 0. We also assume throughout this paper that e,5 £ (0,1). Let Umin and Umax be 
the estimates of min^gq^ u{q) and max^gq^ u{q) respectively. Note that Umax and Umin are ran- 
dom variables resulted by randomized algorithms. A reliable estimate of Umin should guarantee 
Pr I ™^iJj{"Wj^^»T»n^ggQc} >]^_g|>]^_(^ fQj. ^ gniall e and a small 5. Similarly, a reliable estimate 

of Umax should guarantee Pr | ''°'"''^"^^];^"|q°^ j'^^'^''^ > 1 - e| > 1 - 5 for a smaU e and a small 6. 
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2.2 Two Different Approaches 

• Indirect Approach Generate i.i.d. samples for q by the same distribution function w[q). 
Continue the sampling process until we obtain Nc observations of q which belong to Qc- Let 
L be the number of i.i.d. experiments when this sampling process is terminated. Then L is 
a random number with distribution satisfying X^^^^c {-^ ~ — 1 ^"^^ can show that 
E[L\ = Let the observations which belong to Qc be denoted as g*, z = 1, • • • ,Nc. 
Define order statistics Uj, i = 1, • • • ,Nc as the ith smallest one of the set of observations 
{u{ql) : i = 1, • • • ,Nc}, i.e., ui < ••• < uNc- Obviously, it is reasonable to take ui as an 
estimate for minq^ u(q) and as an estimate for maxq^ u{q) if Nc is sufficiently large. 
Henceforth, we need to know Nc which guarantees Pr | "°'™^"|^^''^q^|'^^'^'^ >1 — e| > 1 — 5 

and (or) Pr | "°^"'^"^^|~|q^'|'^^'^^ > 1 — >1 — 5. We call Nc constrained sample size. 

• Direct Approach Let q^,--- ,q^ be N i.i.d samples generated by the same distribution 
function w^q). Define S := {g^, • • • ,q^} f] Qc- Let M be the number of the elements in S. 
Then M is a random number. If M > 1 we denote the elements of S as g*, i = 1, • • • ,M. 
Define order statistics Uj, i = !,••• ,M as the ith. smallest one of the set of observations 
{u{q'c) : i = 1, • • • ,M}, i.e., ni < • • • < nj\,/- hi particular, let Umin = ui and Umax = UM- 
We need to know N which guarantees Pr | ^°'^{»(g)^^^m.n,^geQc} > i _ gj > l - 5 and (or) 

I voi^{u{q)^^urna.,^q&cic} > 1 _ > 1 _ ^. ^Vc can N global sample size. 

3 Exact Distribution 

Define Fu{'y) := ^"of^^ f QcT ^ ' compute the probabilities involved in Section 2, it is important 
to know the associated distribution of any k random variables Fu{ui^), • • • , Fu{uif,), 1 < ii < ■ ■ ■ < 
ik ^ Nc, 1 < k < Nc where Uj^, s = 1, - ■ ■ is order statistics in the context of the indirect 
approach. First, we shall established the following lemma. 

Lemma 1 Let U be a random variable with uniform distribution over [0, 1] and Un, n = 1, ■ ■ ■ , N 
be the order statistics of U, i.e., Ui < ■ ■ ■ < Un- Let ^ = t^ < ti ■ ■ ■ < tk < 1. Define 

G,,,..,, (ti,... ,t,) := (1 -t,)^"Et... (N-nzljiy^^_^^_^y. 

s=l V / 



and 



Then 



^h,-,ik-=\i3ir--,jk)- is<'^jl<N, s = l,---,k 
I 1=1 



5 



Proof. Let js be the number of samples of U which fah into {ts-i,ts], s = 1, • • • ,k. Then the 
number of samples of U which fall into [0, t^] is X^f^j^ ji- It is easy to see that the event < is| is 

equivalent to event {ig < J2i=iji — Furthermore, the event < h, - ■ ■ , IJi^. < is equiva- 
lent to the event {is < ^f=i ji ^ s = 1, • • • , A;}. Therefore, 

(jl,--- J*;)Gli^,... 

□ 



Theorem 1 Let = to < ti < ■ ■ ■ < tk < I and xq = 0, Xk+i = 1, iq = 0, ik+i = N + 1. 

Define fi^^... ^i^{xi,- ■ ■ ,Xk) := UlZo N\ and Bp^^... := {(xi,-- - ,Xk) : < xi < 

■■■ < Xk, Xs < Ps, s = I, - ■ ■ ,k}. Define F{ti,--- ,tk) := Pr{F„(tiiJ < ti,-- - , Fu{ui^) < tfc} and 
Ts := sup|^, Fu{x)<ts} ^uix), s = !,■■■ ,k. Then 

F{ti,- ■ ■ ,tk) = /n,-,ife(xi, • • • ,Xfc) dxi • • • dxfc < / fi^^... ^i^{xi, ■ ■ ■ , Xk) dxi ■ ■ ■ dxk 

and i/ie Zast equality holds if and only if 3x* such that Pr{M((7) < x* \ q € Qc} = ^s, s = 1, • • • , /c. 

Proof. Define ao := — oo and := sup{x : Fu{x) < tg} , a7 := — e, s = 1, ■ ■ ■ ,k where 
e > can be arbitrary small. Let (pg := Fu{aj), s = 1, • • • , fc. We can show that <j)i < (ps if 
ai < as, 1 < I < s < k. In fact, if this is not true, we have <j)i = (ps- Because e can be arbitrarily 
small, we have a~ G (a;, Og). Notice that ai = min{x : Fu{x) > ti} , we have ti <(ps = (pi- On the 
other hand, by definition we know that aj' G {x : Fu{x) < ti} and thus (pi = Fu{ot'^) < ti, which is a 
contradiction. Notice that Fu{'y) is nondecreasing and right-continuous, we have ai < ■ ■ ■ < ak 
and < 01 < • • • < <^fc < 1 and that event {Fu{ui^) < ts\ L = 1} is equivalent to the event 
{ui^ < as\ L = I}. Furthermore, event {-Fn(^^ii) < ti, • • • , Fu{ui^) <tk\L = /} is equivalent to event 
{■Ujj < ai, • • • , Uij^ < Oik\ L = 1} which is defined by k constraints Uj^ < Os, s = 1, • ■ ■ ,k. For 
every / < k, delete constraint < ai if there exists s > / such that as = ai. Let the re- 
maining constraints be U' < a', s = I,-- - ,k' where a\ < ■■■ < a',,. Since all constraints 

*s ^ k 

deleted are actually redundant, it follows that event {ui-^ < ai, ••• , Ui^<ak\L = l} is equiva- 
lent to event <^ u.i < a'j^, • • • , u.i < a^y \ L = l\. Now let js be the number of observations u{q]?j 



k 



which fall into [ag_|,ag), s = I,-- - , A; . Then the number of observations u{q]?) which fall into 
{—oo, Oig) is Yld=iji- It is easy to see that the event ^u^i < a^] L = z| is equivalent to the event 
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< Ylt=iji ^ -^|- Furthermore, the event i^u.i < a'l, ■ ■ ■ , uj < a^, \ L = /| is equivalent to 
event < J2t=iji ^ s = 1, • • • , /c'j. Therefore 

FI{Fuiu^,) <ti, ■■■ , Fuiui^) <tk\ L = l} 
= Pr {uj^ < ai, ■ ■ ■ , Ui^^ < ak\ L = 1} = Ft < a[, ■■■ , n./^ < a^, \ L = 

k ' 
n )] )] 



1' 'V 



{ii.---,V)ei 



Now consider event |c/ij ■ • • , Ui^ < (/"fcl- For every / < k, delete constraint C/j, < 4'i if there 

exists s > I such that (ps = (pi- Notice that (pg = Fu{a~) and 0; < c/ig if a; < a^, 1 < / < s < A:, 
the remaining constraints must be JJ-i < (pg, s = 1, • • • ,k where = Fu(a„ ), s = 1, ■ ■ ■ , k 

3 

and (pi < ■■■ < (j)^,. Since all constraints deleted are actually redundant, it follows that event 

^Ui^ < (pi, ■ ■ ■ , Uif. < <^fc| is equivalent to event I^Uj < (p'l, ■ ■ ■ , CX' < (p]^/^ ■ By Theorem 2.2.3 
in [8] and Lemma [T] 

/ fi^^...^i^{xi, ■■■ ,Xk) dxi ■■■dxk = Pr < (pi, ■ ■ ■ , Ui,^ < (pk^ 



Therefore, Fr {Fu{ui^) < h, F„(-UiJ < L = /} = /d^^ ... /n,--- ' ' ' , a^fc) dxi---dxk- 
It follows that 

oo 

= Pr{FnK) <ti, ••• , i^nK) <tfc j L = /} Pr{L = /} 

l=Nc 
oo „ 

= E / /ji,...,ij^(xi, ■ • • dxi • • • dxfc Pr {L = /} 

l=Nc ><#'fe 

Notice that YaLn, Pr {L = /} = 1. We have 

~ oo 

F{ti,- ■ ■ ,tk) = fi^^...^if^{xi,- ■ ■ ,Xk) dxi- ■ ■ dxk "Y Pr{L = /} 

= / fi^^...^i^{xi,--- ,Xk) dxi---dxk. 
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By the definitions of Ts and (j)s, we know that Y)r-i,---,T^ is the closure of D^^^i^j,--- .(^fe' i-^-i '^Ti,-,Tk 
^<f)\,4>2,-- ,<l>k ^"^^ ^^^t their Lebesgue measures are equal. It follows that 



F{ti,- ■ ■ ,tk) = i fi^^...^ii^{xi,--- ,Xk) dxi---dxk. 

Notice that < t^, s = 1, ■ • • , A:, we have T)T-i,-,Tk ^ ^ti,---,tk ^^'^ hence 

Fihr ■ ■ ,tk) < / fi^^...^i^{xi,--- ,Xk) dxi---dxk, 

•^Dti.t2,...,tj. 

where the equality holds if and only if = t^, s = 1, - ■ ■ ,k, i.e., 3x1 such that Pr{u{q) < x^ \ q £ 
Qc} = ts, s = lr-- ,k. □ 



Remark 1 For the special case of Qc = Q <ind that Fu{.) is absolutely continuous, F(ti,--- ,ti.) 
can be obtained by combining Probability Integral Transformation Theorem and Theorem 2.2.3 in 
l^. However, in robust control problem, the continuity of Fu{.) is not necessarily guaranteed. For 
example, Fu{-) is not continuous when uncertain quantity u{q) equals to a constant in an open set 
o/Qc- We can come up with many uncertain systems in which the continuity assumption for the 
distribution of quantity u[q) is not guaranteed. Since it is reasonable to assume that u[q) is measur- 
able, Theorem[J\ can be applied in general to tackle these problems without continuity assumption by 
a probabilistic approach. In addition, Theorem [I] can be applied to investigate the minimum compu- 
tational effort to come up with a solution with a certain degree of 'reliability' for robust analysis or 
optimal synthesis problems under constraints. 

From the proof of Theorem [H we can see that F{ti, ■ ■ ■ ,tk) is not related to the knowledge of 
L, thus we have the following corollary. 

Corollary 1 Let N2 > Ni > N^. Then Pr {F„(uiJ < ti, • • • , F„(uiJ < tk \ Ni < L < N2} = 
F{ti,--- ,tk). 



4 Quantity Range and Distribution-Free Tolerance Intervals 

In robust analysis or synthesis, it is desirable to know function Fu{.) because it is actually the 
distribution function of quantity u{q) for q E Qc- However, the exact computation of function 
Fu(.) is in general impossible. We shall extract as much as possible the information of Fu{.) from 
observations u{qi), i = 1, • • • , N^. Let V(iVc, i, e) ■= for 1 < i < N^. 

Theorem 2 | ^°'»^Mg)^gm. ^eQc} > ^ _ ^| > ^ _ ^^^^/^ ^/^g equality holds if and only 

if3x* such that Fu{x*) =e. Moreover, Pr | ""'"'^"i^M^Qcr'^"^ > 1 - e} > l-V(iVc, Nc + l-m, e) 
with the equality holds if and only if 3x* such that Fi{u{q) < x* \ q G Qc} = 1 — 
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Proof. Let v{q) = —u{q). Let the cumulative distribution function of v{q) be F^[.) and define order 
statistics Vi, i = 1, ■ ■ ■ , Nc as the i-th smallest one of the set of observations {v{ql) \ i = 1, - ■ ■ , Nc}, 
i.e., vi < ■■■ < vNc- Obviously, Um = —VNc+i-m for any 1 < m < Nc- It is also clear that 
Fy{-x) = 1 - which leads to sup^^,p^^^)^i_^} F^{x) = 1 - e inf^^. p^^^^^^^y Fu{x) = e. 

Apply Theorem [T]to the case of A; = 1, ii = Nc + 'i — we have 

^ / 7^7 ^7 T^,x^^-'^{l-xr-^dx = V{Nc,m,e) 

Jq [Nc - m)l{m - ly. 

where r = sup Fy{x). Therefore, 

{x:Fv{x)<l-e} 

( V0ly,{v{q) <VN,+l~m., q ^ Qc} . ^ \ trpi- N^T 1 

Pr I ^j^^-^^ > 1 - = Pr > 1 - e} 

= 1 - Pr < 1 - e} > 1 - V{Nc, m, e). 

The equality holds if and only if 3x* such that Fu{x*) = e because such a x* exists if and only if 
T = \ — e. It follows that 

f volw {u{q) > iim, q G Qc} ^ , 
rV \ > i — £ 

= p, I vo^^ < ^ ^ > 1 - 4 > 1 - VjNc, m, e) 

[ volyj{Qc} J 

with the equality holds if and only if 3x* such that Fu{x*) = e. 

The second part follows by applying Theorem [T]to the case of k = 1, ii = m. □ 

It is important to note that the two conditions in Theorem [2] are much weaker than the continuity 
assumption which requires that for any p € (0, 1) there exists x* such that Fu{x*) = p. The difference 
is visualized in Figure [21 

In general, it is important to know the probability of a quantity falling between two arbitrary 
samples. To that end, we have 

Corollary 2 Let 1 < m < n < Nc- Suppose u{q) ^ constant in any open set of Qc- Then 
p^^ voi^{u^<Hci)^u^^^^^ > 1 _ = 1 _ v(iVe, Nc + l-n + m, e). 

Since the condition that u{q) ^ constant in any open set of Qc is equivalent to the absolute 
continuity assumption of Fu{x) (see the proof of Theorem 3.3 in [9]), the proof of Corollary [2] can 
be completed by applying Theorem [T]to the case of /c = 2, ii = m, ^2 = n and Fu{x) is continuous. 
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Figure 2: Cases A, B and E guarantee 3x* such that Fu{x*) = e. Cases A, D and E guarantee 3x* 
such that Pr{u{q) < x* \ q & Qc} = 1 — e. Both conditions are violated in Case C.(The various 
magnitude of e and 1 — e is indicated by arrows at different heights.) 

5 Sample Size 

The important issue of the randomized algorithms to robust analysis or optimal synthesis is to 
determine the minimum computational effort required to come up with a solution with a certain 
degree of 'reliability'. First, we consider this issue for the indirect approach. 

5.1 Constrained Sample Size 

To estimate maxq^ u{q) (or determine parameter q achieving maxq^ u{q)), we have 
Corollary 3 Suppose that 3x* such that Pr{u{q) < x* \ q £ Qc} = 1 — Then 



It should be noted that the results in Khargonekar and Tikku [9] and Tempo, Bai, and Dabbene |12j 
correspond to the sufficient part of the above Corollary for the special case of Qc = Q- 
To estimate minq^, u{q) (or determine parameter q achieving minq^ ^(9))) we have 

Corollary 4 Suppose that 3x* such that Fu{x*) = e. Then 



Pr{ 



vol^ {n(g) < UAT,, q 



GQc} 



> 1 - e} > 1 - (5 



if and only if > 




Pr{ 



fo/^ {u{q) > g g Qc} 
volwiQc} 



>l-e}>l-6 



if and only if > 
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To estimate the range of an uncertain quantity with a certain accuracy and confidence level 
apriori specified, we have the following corollary. 



Corollary 5 Suppose that u{q) ^ constant in any open set o/Qc- Then 

,- ^>o^^„ {ui < u{q) < UN,, q £ Qc} 
volyjiQc} 

if and only if fi{Ne) := (1 - e)^^~^ [1 + (iV^ - l)e] < 6. 

Now we investigate the computational effort for the direct approach. 

5.2 Global Sample Size 

To estimate minq^, u{q) (or determine parameter q achieving minq^, u{q)), we have 
Theorem 3 Suppose that 3x* such that Fu(x*) = e. Then 



i' Volw {u{q) > Umin, q £ Qc} 

vol^, {Qc} 



if and only if N > 



H- 



Proof. 



f volw {u{q) > g e Qc} ^ , 

\ voluj{Qc} ~ 

I vol^ {Qc} - ' 

t'S^J I vol^{Qc} - ' 

Notice that {^^^^^i^^^g^^^^^^ > 1-e I M = i} ^ |!:fM^^g|^pQc} > 1 _ e | L < iv} 
with Nc = i the context of the indirect approach. By Corollary [H we know that 

1 volw{u{q) >ui,q£ Qc} > x _ ^ i ^ < jyl = Pr | ^o^"' i'^il) > 9 ^ Qc} > ^ - e\ 

Apply Theorem [2] to the case of Nc = i, m = 1, we have 

r .0/^ {n(g) > ni, g € Qc} ^ ^ _ 1 ^ ^ _ ^^^^ ,) = i _ (i _ 
t foiu-IQc} J 

with the equality holds if and only if 3x* such that Fu{x*) = e. Therefore 
p r.o/.Mg)^^ . 9€Qc} > 1 _ 4 > y f _ _ (1 _ = 1 _ (1 _ 



i=0 
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with the equahty holds if and only if 3x* such that Fu{x*) = e. Finally, notice that (1 — ep) < 6 ii 
and only if > '"^^f ^ . This completes the proof. □ 

It should be noted that sufficiency part of the preceding theorem has been obtained in [9] in the 
context of estimating robust stability margin. By the similar argument as that of Theorem [21 we have 
the following result for estimating maxq^, u{q) (or determine parameter q achieving maxq^ "^(q))- 

Theorem 4 Suppose that 3x* such that Pi{u{q) < x* | g € Qc} = I — s. Then 

Volyj {u{q) < Umax, Q € Qc} . ^ - , . 

Pr{ , >l-£}>l-5 

ln(i) 

if and only if N > — - — — -. 

To estimate the range of a quantity for the system under a certain constraint C, we have 
Theorem 5 Suppose u{q) ^ constant in any open set o/Qc- Then 

VOI^ { Umin < U{q) < Umax, Q G Qc} . , . , ^ TvrN ^ i x 

"^'^ ^^^MQ^} >!-.} = i-Miv)>i-^ 

if and only if fi{N) := (1 - ep)^~^ [1 + (iV - l)ep] < 5. 



Proof. 



f Volw {Umin < u{q) < Umax, g € Qc} ^ _ 

\ uo/^{Qc} 

V^T3 rsf -113 \ V0lu,{Umin <u{q) <Um.ax, q ^Q,c} ^ . 

> Pr Af = « ^ Pr < ; — — — ^ > I — e \ M = I 

^ I volu,{Clc} 



i=0 

N 



^Ai)^ V vol^{Clc} - ^1 



1=0 



Notice that event | ^o<^{^m»n<n(g)|n„.a.. gsQc} > i _ £ | m = i| is equivalent to event 

volyj {ill < u{q) <Ui, q e Qc} 



voly, {Qc} 

with Nc = i in the context of the indirect approach. 
By Corollary [T]and Corollary [Sj we have 



> 1 - e \ L < N 



1 wo/^{Qc} 
f volw {ui < u{q) <Ui, q e Qc} > _ ^1 
\ volui {Qc} ~ J 

1 - (1 - ef-' [1 + (z - l)e] . 
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Therefore, 



p^, f volw {Umin < u{q) < Umax, g g Qc} > ]^ _ ^ 
\ UO/^ {Qc} 

1 - E ■ - pf~'(^ - + - 1)^] 

i=0 ^ ^ j=0 ^ ^ 

1 - ^(1 - epf + ^4^(1 - ep)^ - Npe{l - epf^' 
l-il-spf-'[l + iN-l)ep] 
1-piN), 



which imphes that 



, Volw {Umin < u{q) < Umax, 9 £ Qc} y _ ^ i > 1-5 

vol^ {Qc} ~ 



if and only if p{N) < 6. □ 
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